Evaluating Dialogue Generation Systems via Response Selection
نویسندگان
چکیده
منابع مشابه
Evaluating Dialogue Strategies in Multimodal Dialogue Systems
Previous research suggests that multimodal dialogue systems providing both speech and pen input, and outputting a combination of spoken language and graphics, are more robust than unimodal systems based on speech or graphics alone (Andr ́e, 2002; Oviatt, 1999). Such systems are complex to build and signifi cant research and evaluation effort must typically be expended to generate well-tuned modu...
متن کاملEvaluating Robustness in Dialogue Systems
Robustness is generally regarded as one of the the main requirements of NLD systems, encoding some standards of appropriate system behaviour. However, in order to structure our goals in building robust dialogues systems, we should have a clear de nition of robustness. What is it that we require from a good NLD system? We also need to operationalise this goal and de ne some quanti able measures:...
متن کاملLstm Encoder–decoder for Dialogue Response Generation
This paper presents a dialogue response generator based on long short term memory (LSTM) neural networks for the SLG (Spoken Language Generation) pilot task of DSTC5 [1]. We first encode the input containing different number of semantic units as fixed-length semantic vector with a LSTM encoder. Then we decode the semantic vector with a variant of LSTM and generate corresponding text. In order t...
متن کاملDialogue-Oriented Review Summary Generation for Spoken Dialogue Recommendation Systems
In this paper we present an opinion summarization technique in spoken dialogue systems. Opinion mining has been well studied for years, but very few have considered its application in spoken dialogue systems. Review summarization, when applied to real dialogue systems, is much more complicated than pure text-based summarization. We conduct a systematic study on dialogue-system-oriented review a...
متن کاملTowards Incremental Speech Generation in Dialogue Systems
We present a first step towards a model of speech generation for incremental dialogue systems. The model allows a dialogue system to incrementally interpret spoken input, while simultaneously planning, realising and selfmonitoring the system response. The model has been implemented in a general dialogue system framework. Using this framework, we have implemented a specific application and teste...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Natural Language Processing
سال: 2020
ISSN: 1340-7619,2185-8314
DOI: 10.5715/jnlp.27.677